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Abstract — With  the  convergence  of  multimedia  applications 
and  wireless  communications,  there  is  an  urgent  need  for  develop¬ 
ing  new  scheduling  algorithms  to  support  real-time  traffic  with 
stringent  delay  requirements.  However,  distributed  scheduling 
under  delay  constraints  is  not  well  understood  and  remains  an 
under-explored  area.  A  main  goal  of  this  study  is  to  take  some 
steps  in  this  direction  and  explore  the  distributed  opportunistic 
scheduling  (DOS)  with  delay  constraints.  Consider  a  network 
with  M  links  which  contend  for  the  channel  using  random  access. 
Distributed  scheduling  in  such  a  network  requires  joint  channel 
probing  and  distributed  scheduling.  Using  optimal  stopping 
theory,  we  explore  DOS  for  throughput  maximization,  under  two 
different  types  of  average  delay  constraints:  1)  a  network-wide 
constraint  where  the  average  delay  should  be  no  greater  than  a; 
or  2)  individual  user  constraints  where  the  average  delay  per  user 
should  be  no  greater  than  Om,  m  =  1, . . . ,  M.  Since  the  standard 
techniques  for  constrained  optimal  stopping  problems  are  based 
on  sample-path  arguments  and  are  not  applicable  here,  we  take 
a  stochastic  Lagranglan  approach  instead.  We  characterize  the 
corresponding  optimal  scheduling  policies  accordingly,  and  show 
that  they  have  a  pure  threshold  structure,  i.e.  data  transmission  is 
scheduled  if  and  only  if  the  rate  is  above  a  threshold.  Specifically, 
in  the  case  with  a  network-wide  delay  constraint,  somewhat 
surprisingly,  there  exists  a  sharp  transition  associated  with  a 
critical  time  constant,  denoted  by  a*.  If  a  is  less  than  a*, 
the  optimal  rate  threshold  depends  on  a;  otherwise  it  does  not 
depends  on  a  at  all,  and  the  optimal  policy  is  the  same  as  that 
in  the  unconstrained  case.  In  the  case  with  individual  user  delay 
constraints,  we  cast  the  threshold  selection  problem  across  links 
as  a  non-cooperative  game,  and  establish  the  existence  of  Nash 
equilibria.  Again  we  observe  a  sharp  transition  associated  with 
critical  time  constants  {a™},  in  the  sense  that  when  a™  >  am 
for  all  users,  the  Nash  equilibrium  becomes  the  same  one  as  if 
there  were  no  delay  constraints. 

I.  Introduction 

Channel-aware  scheduling  for  achieving  the  rich  diversity 
inherent  in  wireless  communications  has  recently  emerged  as 
a  promising  technique  for  improving  spectrum  efficiency  in 
wireless  networks.  Most  existing  studies  along  this  line  require 
centralized  scheduling  [1],  [2],  [3],  [4],  and  little  work  has 
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been  done  on  developing  distributed  algorithms  to  provide 
diversity  gains  for  ad  hoc  communications,  partially  due  to 
the  challenge  of  distributed  learning  of  time-varying  channel 
information. 

Recent  work  [5]  has  taken  some  initial  steps  to  develop 
distributed  opportunistic  scheduling  (DOS)  to  reap  multiuser 
diversity  and  time  diversity  in  wireless  ad  hoc  networks.  The 
basic  idea  of  DOS  is  that  once  a  successful  channel  probing 
has  been  made  (through  a  successful  channel  contention),  the 
successful  link  may  decide  to  continue  data  transmission  if 
the  observed  channel  condition  is  “good”;  otherwise,  it  may 
skip  the  transmission,  and  let  all  the  links  re-contend  for  the 
channel,  in  the  hope  that  some  links  with  better  channel  condi¬ 
tions  can  transmit  after  the  re-contention.  Intuitively  speaking, 
for  time  varying  channel  conditions,  different  links  at  different 
time  slots  experience  different  channel  conditions.  It  is  likely 
that  after  further  probing,  the  channel  can  be  taken  by  a  link 
with  a  better  channel  condition,  resulting  in  higher  network 
throughput.  Hence,  the  multiuser  diversity  across  links  and 
the  time  diversity  across  slots  can  be  exploited  in  a  joint 
manner.  On  the  other  hand,  each  channel  probing  comes  with 
a  cost  in  terms  of  time.  Clearly,  there  is  a  tradeojf  between  the 
throughput  gain  from  better  channel  conditions  and  the  cost 
for  further  channel  probing.  The  desired  tradeoff  boils  down 
to  judiciously  choosing  the  optimal  stopping  time  for  channel 
probing  and  the  transmission  rate,  in  the  sense  of  maximizing 
the  overall  network  throughput.  Using  the  optimal  stopping 
theory  [6],  it  has  been  shown  in  [5]  that  the  optimal  scheme 
turns  out  to  be  a  pure  threshold  policy,  and  the  threshold  is 
the  optimal  network  throughput. 

While  significant  progress  has  been  made  on  opportunistic 
scheduling  algorithms,  scheduling  with  delay  guarantees  is 
still  not  well  understood.  Many  wireless  applications,  such 
as  multimedia  traffic,  have  stringent  delay  requirements.  For 
example,  a  VOIP  application  typically  requires  an  average 
delay  less  than  200ms  to  maintain  a  normal  conversation.  For 
other  applications,  such  as  live  video  streaming  or  monitoring 
traffic,  the  tolerance  to  delay  is  even  smaller,  and  there  may  be 
a  limited  lifetime  during  which  a  packet’s  information  remains 
valid.  Then,  the  delivery  of  such  packets  has  to  be  before  the 
deadline,  because  otherwise  the  information  would  become 
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outdated  and  useless. 

Unfortunately,  little  work  has  been  done  on  developing 
distributed  opportunistic  scheduling  while  taking  delay  into 
consideration.  Without  delay  constraints,  it  is  possible  that  the 
system  may  spend  an  arbitrarily  long  period  of  time  on  channel 
probing,  looking  for  better  channel  conditions.  This  may 
significantly  degrade  the  QoS  performance  of  delay-sensitive 
applications,  for  which  the  delay  performance  is  of  critical 
importance.  Therefore,  distributed  opportunistic  scheduling 
must  strive  not  only  to  maximize  the  throughput,  but  also 
to  meet  the  delay  constraints.  Needless  to  say,  delay-driven 
scheduling  is  challenging,  considering  the  distributed  nature 
of  ad  hoc  communications.  A  main  objective  of  this  study 
is  to  obtain  a  rigorous  understanding  of  DOS  under  delay 
constraints,  which  is  known  to  be  important  but  hard. 

In  this  paper,  we  study  DOS  under  the  average  delay 
constraint  from  two  different  perspectives,  namely,  network¬ 
wide  average  delay  constraint  and  user-specific  average  delay 
constraint.  Specifically,  average  delay  constraint  here  refers  to 
an  ensemble  constraint  after  taking  average  over  many  packet 
transmissions. 

First,  we  consider  the  average  delay  constraint  from  a 
network-centric  point  of  view,  where  links  cooperate  to  maxi¬ 
mize  the  overall  network  throughput,  subject  to  the  constraint 
that  the  network-wide  average  probing  and  transmission  time 
is  no  greater  than  a  given  time  constant  a.  We  note  that 
the  network-wide  average  delay  constraint  is  applicable  to 
applications  such  as  event  monitoring  by  sensor  networks 
where  a  group  of  sensor  nodes  observe  the  same  phenomenon 
and  try  to  deliver  the  same  messages  to  the  sink  node.  Thus, 
a  network-wide  constraint  is  to  ensure  that  every  message 
reaches  the  sink  node  by  a  given  deadline.  Optimal  scheduling 
under  this  network-wide  average  delay  constraint  is  equivalent 
to  a  constrained  optimal  stopping  problem.  However,  the 
standard  techniques  for  constrained  optimal  stopping  prob¬ 
lems  [7]  cannot  be  used  to  solve  our  problem  here.  This 
is  because  those  standard  techniques  are  based  on  sample- 
path  arguments,  but  the  problem  with  average  constraints 
involves  averaging  over  many  sample  paths.  Instead,  we  take 
a  stochastic  Lagrangian  approach  to  transform  the  constrained 
problem  into  an  unconstrained  one.  For  the  case  where  the 
rate  follows  a  continuous  distribution,  we  are  able  to  show 
that  the  duality  gap  does  not  exist.  Intuitively  speaking,  the 
continuity  of  channel  fading  distribution  ensures  that  the 
channel  exhibits  sufficient  randomization  to  close  the  gap 
between  the  constrained  primal  problem  and  the  unconstrained 
dual  problem  [8].  We  then  characterize  the  corresponding 
threshold-based  optimal  scheduling  algorithm  and  its  through¬ 
put.  Somewhat  surprisingly,  we  find  there  exists  a  sharp 
transition  for  the  optimal  threshold  tied  to  a  critical  time 
constant,  a*,  in  the  sense  that  if  a  is  less  than  a*,  the  optimal 
threshold  is  upper-bounded  by  a  function  of  a;  otherwise, 
the  imposed  delay  constraint  has  no  impact  on  the  optimal 
scheduling,  and  the  optimal  threshold  is  the  same  as  that  in 
the  unconstrained  case. 

Next,  we  explore  distributed  scheduling  under  the  average 


delay  constraint  from  a  user  centric  perspective,  where  each 
link  seeks  to  maximize  its  own  throughput  subject  to  the 
constraint  that  the  expected  user  delay  should  be  no  greater 
than  its  own  delay  constraint  amjtn  =  We  treat 

the  threshold  selection  problem  under  the  individual  delay 
constraint  as  a  non-cooperative  game.  We  show  that  the  Nash 
equilibrium  exists  for  this  constrained  non-cooperative  game. 
Our  results  reveal  that  there  exists  a  vector  of  critical  time 
constants  as  the  counterpart  to  that  in  the  network¬ 

centric  case,  such  that  only  when  all  the  delay  parameters 
ctm  >  ctm  can  the  Nash  equilibrium  become  the  one  for  the 
unconstrained  case.  We  further  provide  an  iterative  algorithm 
to  find  the  Nash  equilibrium  and  show  the  convergence. 

To  the  best  of  our  knowledge,  this  is  the  first  channel- 
aware  distritbuted  opportunistic  scheduling  under  the  delay 
constraints.  We  believe  that  these  initial  steps  are  useful  for 
developing  distributed  scheduling  for  delay  sensitive  applica¬ 
tions. 

The  rest  of  the  paper  is  organized  as  follows.  We  present 
the  system  model,  and  provide  the  background  on  the  dis¬ 
tributed  opportunistic  scheduling  without  delay  constraints  in 
Section  II.  In  Section  III,  we  study  DOS  under  average  delay 
constraints  from  the  network-centric  perspective  and  the  user¬ 
centric  perspective.  The  numerical  results  are  presented  in 
Section  IV.  Finally,  we  draw  our  conclusions  and  discuss  the 
future  work  in  Section  V. 

II.  System  Model  and  Background 

We  consider  a  single-hop  collocated  random  access  network 
with  M  links  [5],  where  link  m  contends  for  the  channel 
with  probability  p^,  rn  =  1, . . . ,  M.  A  collision  model  is 
assumed  for  the  random  access,  where  a  successful  channel 
contention  of  a  link  means  that  no  other  links  transmit  at 
the  same  time.  Accordingly,  the  overall  successful  contention 
probability,  p^,  is  then  given  by  Em=i(Frn  [9]- 

It  is  clear  that  the  number  of  slots  (denoted  as  K)  for  a 
successful  channel  contention  is  a  Geometric  random  variable, 
i.e.,  K  ~  Geometric{ps).  Let  r  denote  the  duration  of  a  mini¬ 
slot  for  channel  contention.  It  follows  that  the  random  duration 
corresponding  to  one  round  of  successful  channel  contention 
is  Kt,  with  expectation  of  r/ps-  For  convenience,  we  call  the 
random  duration  of  achieving  a  successful  channel  contention 
as  one  round  of  channel  probing. 


r 


T 

Fig.  1.  Realization  of  channel  probing  and  data  transmission 

To  get  a  more  concrete  sense  of  the  dynamics  of  joint 
channel  probing  and  distributed  scheduling,  we  depict  in  Fig. 


3 


1  a  sample  realization  of  N  rounds  of  channel  probing  and 
one  single  data  transmission.  Let  s{n)  denote  the  successful 
link  at  the  n-th  round  of  channel  probing  (successful  channel 
contention)  and  Rn,s{n)  denote  the  corresponding  transmission 
rate.  Specifically,  suppose  after  the  first  round  of  channel 
probing  with  a  duration  of  Ki  slots,  i?i,s(i)  is  small  due  to 
poor  channel  condition,  s(l)  will  then  give  up  its  transmission 
opportunity  and  let  all  the  links  re-contend.  This  probing 
process  continues  for  N  rounds  until  link  s{N)  transmit  as 
link  s{N)  has  a  high  transmission  rate  with  good  channel 
condition. 

In  a  wireless  network,  Rn.s{n)  is  random  since  it  depends 
on  the  time  varying  channel  conditions.  We  assume  that 
Rn,s{n)jn  =  1,2,...  are  statistically  independent,  which  in 
general  holds  in  many  practical  scenarios  of  interest.  For  con¬ 
venience,  let  Rn  denote  the  transmission  rate  corresponding  to 
the  n-th  round  successful  channel  probing,  i.e.,  =  Rn,s(n)- 

Accordingly,  i?„  has  the  following  compound  distribution  [5]: 

M 

P{Rn  <  r)  =  V  (1) 

where  -  Pi)  is  the  successful  probing 

probability  of  user  m,  and  F’m(')  denotes  the  distribution 
for  each  link  m  G  {1,2, Mj.  In  this  study,  we  assume 
that  Fra{r)  is  continuous  in  r.  Later,  we  will  see  that  this 
continuous  assumption  on  the  channel  statistics  will  ensure 
that  there  is  no  duality  gap  when  the  constrained  problem  is 
relaxed  to  an  unconstrained  dual  problem,  and  hence  is  of 
critical  importance  to  the  existence  of  optimal  solutions  for 
the  constrained  problem. 

A.  Background:  DOS  Without  Delay  Constraint 

In  [5],  we  have  studied  distributed  opportunistic  scheduling 
(DOS)  without  delay  constraint.  Specifically,  we  have  shown 
that  the  throughput  maximization  problem  can  be  cast  as 
a  maximal  rate  of  return  problem  in  the  optimal  stopping 
theory  [6],  [10],  where  the  rate  of  return  is  the  average  network 
throughput,  X,  given  by 


1,2,...,}  are  independent,  and  p  is  finite.  For  completeness, 
we  restate  the  following  result  from  [5]. 

Lemma  2.1:  The  optimal  stopping  rule  N*  exists,  and  is 
given  by 

N*  =  min{n  >  1  :  >  a;*}.  (5) 

The  threshold  in  (5)  is  the  maximum  throughput  x* ,  which  is 
the  unique  solution  to 

Xl~ 

E{R-x)+  =  —,  (6) 

PsT 

where  i?  is  a  random  variable  and  has  the  same  distribution 
as  i?„. 

III.  DOS  Under  Average  Delay  Constraints 

In  this  section,  we  generalize  the  above  study  to  the  case 
with  average  delay  constraints.  Specifically,  we  study  the 
average  time  constraint  from  two  different  perspectives:  a 
network-wide  average  delay  constraint,  or  individual  average 
delay  constraints. 

A.  DOS  under  the  Network-Centric  Average  Delay  Constraint 

In  this  section,  we  treat  distributed  opportunistic  scheduling 
under  average  delay  constraint  from  a  network-centric  per¬ 
spective.  To  this  end,  we  formulate  the  DOS  as  a  cooperative 
game  in  which  all  the  links  collaborate  to  maximize  the  overall 
network  throughput  under  the  network-wide  average  delay 
constraint,  which  equivalent  to  impose  an  additional  constraint 
on  E[Tn]. 

We  have  the  following  problem: 

T,  •  •  E[RnT] 

Pc  :  maximize  — ,  ,  (7) 

veQ.  E[Tn]  ’ 

where 

Qa  =  {N-.N>l,E[TN]<a}.  (8) 

Comparing  Qa  with  Q  in  (4),  it  can  be  seen  that  the  newly 
imposed  delay  constraint  dictates  that  the  average  duration  of 
channel  probing  and  transmission  must  be  no  greater  than  a. 
For  convenience,  define 


E[RnT] 

E[Tn] 


where  r„  =  KjT  -f  T. 
i=i 


(2) 


Note  that  W  is  a  stopping  time  if  {N  =  n}  and 
is  J>i-measurable,  where  iF„  is  the  cr-field  generated  by 
{{p\hj\'^,Kj),j  =  1,2,  ...,n}. 

The  distributed  opportunistic  scheduling  algorithm  that 
maximize  the  network  throughput  is  given  by  the  optimal 
stopping  rule,  N*,  that  solves  the  maximal  rate  of  return 
problem  in  (2),  i.e.. 


N*  =  argmax 

N£Q 


E[RnT] 

E[Tm] 


*  A  E[RnT] 

®  1  ’ 
iveQ  x^lJ-Nl 


(3) 


where 

Q^{N-.N>1,E[Tn]<oo}.  (4) 


N* 


=  argmax 

NeQo, 


E[RnT] 
E[Tn]  ’ 


A 

=  sup 


E[RnT] 

E[Tn] 


(9) 


Clearly,  a  has  to  be  greater  than  ^  -f  T,  because  even  if 
the  data  transmission  follows  immediately  after  a  successful 
channel  contention  regardless  of  the  channel  condition,  it  takes 
a  duration  of  ^  -f  T  on  average  for  the  network  to  transmit  a 
data  packet.  In  other  words,  ^-|-T  is  the  minimum  achievable 
average  delay. 

Let  denote  the  continuous  distribution  of  {i?„}  and 

a*  denote  the  unique  solution  to  the  following  equation  (in 

y)- 


E 


Rn  —  E, 


-1 


1  - 


Ps{y-T) 


(10) 


We  have  shown  that  the  optimal  stopping  rule  for  the  above 
problem  can  be  found  if  the  channel  coefficients  = 


PsT 


-F- 


1  - 


Ps{y-T) 
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We  have  the  following  result  regarding  the  optimal  scheduling 
policy  N*  and  the  optimal  throughput  a:*  for  the  constrained 
optimization  problem  Pc. 

Proposition  3.1:  1)  When  a  <  a*,  the  optimal  scheduling 
policy  N*  is  given  by 


=  (11) 

and  the  optimal  throughput,  x* ,  is  given  by 


- 


1  - 


+ 


PsT 

T 


l--\E 
a 


p^{a  -  T) 

fljv  -  1  - 


(12) 


Ps{OL  -  T) 


11)  When  cx  >  a*,  we  have  that  TV*  =  N*  and  a;*  =  x* , 
where  N*  and  x*  are  shown  in  (5)  and  (6),  respectively. 

The  proof  can  be  found  in  Appendix  A. 

Remarks: 

1)  The  above  result  reveals  that  the  optimal  stopping  rule 
under  the  network-wide  average  time  constraint  sce¬ 
nario,  A"*,  is  a  pure  threshold  policy  and  the  threshold 
hinges  heavily  on  the  time  constraint  a.  Interestingly, 
there  exists  a  sharp  transition  associated  with  the  critical 
time  constant,  a*,  in  the  sense  that  if  a  is  less  than 
a*,  the  optimal  threshold  depends  on  a;  otherwise, 
the  imposed  constraint  has  no  impact  on  the  optimal 
scheduling,  and  the  optimal  policy  remains  the  same  as 
if  the  time  constraint  were  removed. 

2)  We  observe  from  the  proof  that  under  the  continuous 

assumption  on  the  channel  statistics,  the  strong  duality 
holds.  In  general,  is  the  concave  hull  of  (j){a) 

that  is  not  necessarily  concave  [8]  (see  Fig.  2  for 
a  pictorial  illustration).  Accordingly,  there  may  exist 
duality  gaps.  Somewhat  surprisingly,  it  turns  out  when 
the  rate  distribution  is  continuous,  ^/'(cx)  coincides  with 
4>{a).  Our  intuition  is  as  follows:  when  the  channel 
exhibits  sufficient  randomization,  then  there  is  no  duality 
gap,  and  solving  the  relaxed  problem  is  equivalent 
to  solving  the  primal  problem.  In  contrast,  when  the 
channel  distribution  is  discrete,  the  duality  gap  is  zero 
only  at  countably  many  points  [11].  We  note  that  the 
underlying  rationale  key  idea  behind  the  above  result  is 
kin  to  the  hidden  convexity  property  established  in  [12], 

[13]. 

3)  Observe  that  to  compute  the  optimal  threshold  offline, 
network-wide  channel  statistical  information  is  required. 
We  note  that  an  online  algorithm  can  be  developed, 
based  on  local  information  only,  to  find  estimate  the 
optimal  threshold  similar  to  that  in  [5]. 


B.  An  Iterative  Algorithm  for  Computing  a* 
Comparing  (6)  and  (10),  it  is  easy  to  see  that 


X*  =F- 


1  - 


Ps{a*  -  T)) 


(13) 


Fig.  2.  Duality  gap  between  the  primal  and  the  dual  problems. 


or  equivalently. 


(14) 


Based  on  (14),  we  can  use  the  iterative  algorithm  developed 
in  [5]  to  find  a*.  More  specifically,  we  first  use  the  following 
iterative  algorithm  to  compute  x*: 


Xk+i  =  ^{xk)  for  fc  =  0, 1,2, ...,  (15) 

where  <i)(x)  =  xq  is  a  positive  initial  value. 

Then,  a*  can  be  obtained  from  (14). 

Since  ^ 

based  on  the  above  relationship  of  x*  and  cx*,  we  can  further 
simplify  the  optimal  threshold  policy  presented  in  Prop.  3.1 
as  follows. 

Corollary  3.1:  The  optimal  scheduling  policy  A"*  is  given 
by 

A*  =  min  <  n  >  1  :  _R„  >  min  (  (  1 - ,  ^ 

I  V  V  Ps{a-T) 

and  the  corresponding  optimal  throughput  x*  is  given  by  (17), 
!(•)  is  an  indicator  function,  and  x*  and  cx*  are  given  in  (6) 
and  (10),  respectively. 


1  - 


Ps(x-T) 


is  monotonically  increasing  in  x. 


C.  DOS  under  Individual  Average  Delay  Constraints 

In  the  above  section,  the  average  delay  constraint  is  with 
respect  to  the  whole  network.  In  some  cases,  different  users 
may  have  different  individual  delay  requirements.  Therefore,  it 
is  of  great  interest  to  study  the  impact  of  the  individual  average 
time  constraint.  More  specifically,  we  focus  on  DOS  from  a 
user-centric  perspective,  where  each  link  seeks  to  maximize  its 
own  throughput  under  its  individual  average  delay  constraint 
E[Tm]  <  am,  for  m  =  1,...,M.  To  this  end,  we  treat 
joint  channel  probing  and  distributed  scheduling  as  a  non- 
cooperative  game,  where  each  user  chooses  its  threshold  in 
a  selfish  manner  to  maximize  its  own  throughput,  subject  to 
its  own  individual  average  time  constraint. 
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xl  =  x*I{a  >  a*)  +  <;  -Fp^  (  1  - 


T  . 


Ps{a  -  T) 


+ 


PsT 


T 

1-  -  ]  E 
a 


Rn  —  Fp^  {  1  — 


Ps{a-T) 


I(a  <  a).  (17) 


For  a  given  set  of  thresholds  across  links,  {(j)ryi,m  = 
1, 2, M},  it  is  easy  to  see  that  the  expected  channel  probing 
and  transmission  time  for  link  m,  E[Tm],  is  given  by  [5] 


(18) 


Note  that  E[Tra]  is  composed  of  two  parts:  1)  the  effective 

channel  probing  time  - - ,  and  2)  data 

transmission  time,  T.  The  average  throughput  of  link  m  can 
be  expressed  as  (see  Lemma  4.1  in  [5]) 


Ps,m  rdFjn{r) 

s  +  EZiPsA^-mi)y 


(19) 


where  0  =  {(j)i,(j>2,  ■■■,  4>m}  is  the  threshold  vector. 

Following  [5],  we  cast  the  threshold  selection  prob¬ 
lem  across  different  links  as  a  non-cooperative  game,  in 
which  each  individual  link  chooses  its  threshold  (f)m  to 
maximize  its  own  throughput,  dm,  given  its  own  average 
probing  and  transmission  time  constraint,  am-  Let  G  = 

[{1,2,  M},  Xm^{l,2,...,M}^-m,  G  {!)  2,  ...,  M}}] 

denote  the  non-cooperative  threshold  selection  game.  The  links 
in  {1,2,  are  the  players  of  the  game.  Am  =  {4>m\0  < 

(/)m  <  00}  is  the  action  set  of  the  player  to,  and  dm  is  the 
utility  function  for  the  player  to.  The  non-cooperative  game 
can  be  formulated  as  follows: 


To  this  end,  we  examine  the  existence  of  of  Nash  equilib¬ 
rium.  Using  Prop.  (3.1),  we  have  the  following  result  on  the 
existence  of  the  Nash  equilibrium  for  the  game  G. 

Proposition  3.2:  Under  the  condition  in  (22),  there  exists  a 
Nash  equilibrium  for  the  game  G,  and 


(pm  =  min 
where  x* 


r  +  j:f^^psAl-F:m)T 

Xm,  Fp  (1 - - — - 

Ps -t  ) 


satisfies  the  following  equation: 


Ps,m  /“  rdEmir) 


Xrr,  = 


5+Y.tlPsA^-F^m) 


(24) 


The  proof  follows  directly  from  [5]. 

It  is  not  surprising  to  see.  Prop.  3.2  reveals  that  the  optimal 
threshold  in  the  Nash  equilibrium  is  upper-bounded  by  a 
function  of  the  time  constraint  am,  and  other  users’  thresholds. 
When  am  oo,Vto,  we  have  that 


X 


/* 

m'’ 


where  x'm  can  be  computed  by 

Ps.mJ A  rdEmir) 


S  +  EfL,Ps,ia-Fi«)) 


,  Vto, 


(25) 


(G)  max  dmi0),  subject  to  E[Tm]  <  am,  (20) 
Vto  =  1, 2, ...,  M. 

D.  Nash  Equilibrium  under  Individual  Average  Delay  Con¬ 
straints 


which  boils  down  to  the  unconstrained  case  in  [5]. 
Define  for  to  =  1, . . . ,  M, 


Ps(l  -  Fmix'A)) 


(26) 


Next,  we  investigate  the  corresponding  Nash  equilibrium 
under  individual  average  delay  constraints. 

Definition  3.1:  A  threshold  vector  0*  =  {(j)\,(f)2,  ...,4)%]} 
is  said  to  be  a  Nash  equilibrium  of  game  G  if 


dmifim,F>-m)  >  ^A<l>m,0-m)  A  <l>m  G  Am,  (21) 

where  01^  =  [fii,  ...,(j)m-l,(l)m+l, 

Definition  3.1  reveals  that  when  the  Nash  equilibrium  is 
achieved,  no  link  can  increase  its  throughput  by  changing  its 
threshold  from  the  equilibrium,  given  the  thresholds  of  other 
links. 

Along  the  same  line  as  in  network-centric  case,  we  need 
the  following  conditions  on  each  individual  average  delay 
constraint  am- 


r  +  E 


M 


Ps,m 


+  T. 


(22) 


As  the  counterpart  to  the  critical  time  constant  a*  in  the 
network-centric  case,  the  vector  {ajjj}  defined  above  serves 
as  the  critical  time  constant  vector  for  the  individual  average 
delay  constraint  case.  Particularly,  we  have  the  following 
result: 

Proposition  3.3: 

fim  =  x'm  if  and  only  if  am  >  cimAm. 

Proof:  If  am  >  ctm ,  Vto,  it  is  straightforward  to  examine  that 
4’m  =  x'm  satisfies  (23)  and  (24).  On  the  other  hand,  if  there 
exists  any  to  such  that  am  <  ctm,  il  ^an  be  seen  from 
(23)  that  (pm  <  x'm,  and  the  proof  is  concluded.  I 

Prop.  3.3  reveals  that  only  when  all  the  time  constants  are 
larger  than  the  corresponding  critical  time  constants  can  the 
Nash  equilibrium  points  under  the  individual  average  delay 
constraint  belong  to  that  for  the  unconstrained  case. 
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E.  Iterative  Algorithm  for  Finding  Nash  Equilibrium 

Based  on  (23),  we  have  the  following  best  response  strategy 
to  compute  the  Nash  equilibrium: 


(t>m{k  +  1) 


T  +  -  F^{(i)i{k)))T 

Ps{am  -  T) 


and  x*^{k) 

for 


Ps,m  fx^(k) 

fc  =  0,l,2, ...  Vto  =  1,2,  ...,M.  (28) 


The  following  proposition  establishes  the  convergence  of 
the  above  best  response  strategy. 

Proposition  3.4:  Suppose  that  the  Nash  equilibrium  is 
unique.  Then,  for  any  non-negative  initial  value  0(0),  the 
sequence  {0{k)},  generated  by  the  iterative  algorithm  in  (27), 
converge  to  the  Nash  equilibrium  0*,  as  fc  — >  oo.  The  proof 
follows  directly  from  [5]. 


IV.  Numerical  Results 

In  this  section,  we  study,  by  numerical  examples,  the  perfor¬ 
mance  of  the  DOS  under  delay  constraints.  Unless  otherwise 
specihed,  we  assume  that  r,  T,  p^  and  M  are  chosen  such  that 
S  —  t/T  —  0.1, Ps  =  exp(— 1).  We  consider  the  continuous 
rate  case  only,  assuming  that  the  instantaneous  rate  is  given 
by  the  Shannon  channel  capacity,  i.e., 

Rn  —  log(l  -I-  nats/s/Hz,  (29) 


where  p  is  the  normalized  average  SNR,  and  /i„  is  the  ran¬ 
dom  channel  coefficient  with  a  complex  Gaussian  distribution 
CA/^(0,1).  Accordingly,  the  distribution  of  the  transmission 
rate  is  given  by 

fHW  =  l-exp(-£E<^).  (30) 

A.  The  Case  with  Network-Wide  Average  Delay  Constraint 

We  hrst  provide  numerical  examples  for  DOS  under  the 
network-wide  average  delay  constraint.  It  follows  from  (17) 
and  (30)  that  the  maximal  throughput,  x*,  can  be  expressed 
as  in  (31),  where  7  =  (l  -  C  =  ^{1  -  ^), 

X*  satisfies  the  following  fixed  point  equation: 


X 


* 


exp^\ 

P  A 


(32) 


and  Ei(x)  is  the  exponential  integral  function  defined  as 


Ei{x)  ^ 


r°°  exp(-f) 

J.  t 


(33) 


In  Fig.  3,  we  compare  the  optimal  throughput  a;*  under 
delay  constraints,  against  that  corresponding  to  two  other 
schemes:  1)  the  throughput,  denoted  as  a;„,  corresponding 
to  the  naive  threshold  policy  f  =  F^^  ~  p  {a-T}) 

always  enforces  that  the  average  delay  equal  the  delay  con¬ 
straint,  and  2)  the  throughput,  denoted  as  x*,  corresponding  to 


Fig.  3.  Maximal  throughput  for  different  values  of  a  at  different  p 


the  optimal  threshold  policy  f  =  x*  with  no  delay  constraint. 
We  plot  them  for  different  a  at  different  average  SNR  p  = 
5,10,15,20,25.  It  is  clear  that  x*  is  an  increasing  function 
of  the  average  SNR  p  for  a  given  a  as  expected.  Another 
important  observation  from  Fig.  3  is  that  Xa  intersects  with  x* 
at  its  peak  point,  which  is  exactly  the  critical  time  constant,  a*. 
Note  that  Xa  =  tc*  when  r/ps  T  <  a  <  a*,  and  cc*  =  x* 
when  a  >  a* .  That  is  to  say,  a*  is  the  transition  point  beyond 
which,  the  optimal  scheduling  policy  would  be  the  same  as  that 
without  the  delay  constraint.  Intuitively  speaking,  the  optimal 
scheduling  policy  under  delay  constraints  can  be  viewed  as  a 
marriage  between  the  naive  threshold  scheme  and  the  optimal 
threshold  scheme  without  considering  the  constraint. 


a 


Eig.  4.  E[Tpf]  of  network  versus  average  probing  and  transmission  time 
constraint  of  a 


To  gain  a  deeper  understanding  of  the  critical  time  point, 
a*,  we  plot  in  Fig.  4  the  average  probing  and  transmission 
time. 


E[Tn] 


(34) 


under  the  above  mentioned  three  schemes.  It  can  be  seen 
from  Fig.  4  that  the  average  probing  and  transmission  time 
would  always  be  the  same  value  of  a,  under  the  threshold 


7 


=  ®*I(a>a*)  +  ^+CTexpQ^  7 exp  j 


+  El 


( exp(7) \ 


V 


J 


—  CT'y  I  exp  — 


exp  (7)  -  1 


I(q;  <  a*).  (31) 


policy  with  (f)  =  Fj^  ^  ~  p  (a-T))  ■  threshold  policy 

with  <j>  =  X*,  the  average  probing  and  transmission  time  is  a 
constant  regardless  of  a.  The  critical  constraint  point,  a*  is 
shown  in  this  figure  as  the  crossing  point  between  these  two 
threshold  methods.  This  also  explains  the  physical  meaning 
of  this  critical  point:  when  a  <  a*,  the  threshold  policy 
with  (j>  =  ~  p  (a-T)')  optimal  since  it  “pushes” 

the  average  time  towards  the  allowed  limit  to  achieve  a  higher 
throughput;  when  a  >  a*,  since  the  threshold  policy  with 
(j>  =  X*  already  satisfies  the  delay  constraint  while  achieving 
the  maximum  throughput,  it  is  also  optimal  in  the  case  under 
the  delay  constraint.  This  phenomena  can  be  also  observed 
from  Fig.  3:  after  the  critical  point,  the  throughput  is  decreas¬ 
ing  if  the  scheduling  policy  still  follows  the  original  time 
constraint  policy  with  Therefore, 

the  optimal  scheduling  policy  (shown  in  circle)  under  the  delay 
constraint  should  be  the  same  as  the  case  without  the  delay 
constraint,  when  a  >  a*. 


Fig.  5.  a*  for  different  p  at  different  ps 

It  is  clear  from  the  above  discussions  that  the  network 
throughput  suffers  a  loss  due  to  the  delay  constraint  when  a 
falls  into  the  range  of  [r/ps  +  T,  a*).  Thus,  a*  could  be  used 
to  measure  the  criticality  of  the  delay  constraint:  the  smaller 
a*,  the  less  the  criticality  of  the  delay  constraint.  To  get  a 
better  understanding  of  the  characteristics  of  the  critical  time, 
we  plot  in  Fig.  5  a*  as  a  function  of  p  and  the  contention 
successful  probability  ps.  It  can  be  seen  from  the  figure  that 
a*  is  a  decreasing  function  of  p  for  a  given  p^.  That  means  the 
effect  of  delay  constraint  is  less  critical  at  high  SNR.  We  also 
observe  that  a*  is  a  decreasing  function  of  ps  for  a  given  p. 
This  is  because  a  larger  ps  indicates  that  the  users  can  access 
and  probe  the  channel  with  smaller  cost  (in  terms  of  contention 
time),  and  hence,  can  meet  more  stringent  delay  requirements. 
Overall,  Fig.  5  suggests  that  the  importance  of  our  proposed 


approach  becomes  increasingly  prominent  in  low  SNR  and/or 
low  successful  contention  probability  regions. 

B.  The  case  with  Individual  Average  Time  Constraints 

In  this  section,  we  examine  the  DOS  performance  with 
individual  user’s  average  delay  constraint. 


TABLE  I 

Critical  time  for  each  individual  link 


Link 

iPm  =  0.125) 

{pm  —  6) 

Link  1 

66.12  (pi  =  2) 

82.38  (pi  =  0.075) 

Link  2 

64.81  (p2  =  4) 

69.51  (p2  =  0.100) 

Link  3 

64.14  (p3  =  6) 

62.62  (p3  =  0.125) 

Link  4 

63.70  (p4  =  8) 

58.84  (p4  =  0.150) 

Link  5 

63.39  (p5  =  10) 

56.96  (p5  =  0.175) 

We  first  examine  in  Table  I  the  behavior  of  with  fixed 
contention  probability  of  pm  =  0.125  but  with  different 
average  SNR  (pm)  across  links.  The  result  shows  that  the 
link  with  higher  average  SNR  has  a  lower  for  the  same 
reasoning  explained  in  Fig.  5.  We  next  examine  the  behavior  of 
critical  time  with  a  fixed  average  SNR,  but  with  the  different 
contention  probability  (pm)  across  links.  It  can  be  observed 
that  the  link  with  higher  contention  probability  has  a  lower 
critical  time  constant.  Similar  to  the  reason  for  the  network 
centric  case,  the  link  with  higher  contention  probability  has 
the  lower  unconstrained  expected  probing  and  transmission 
time,  and  therefore  the  time  constraint  is  less  stringent.  The 
results  imply  that  the  effects  of  imposing  a  constraint  on  the 
individual  link  becomes  less  significant  when  the  average  SNR 
and/or  the  contention  probability  of  the  link  increases. 


TABLE  II 

Convergence  Behavior  of  the  best  response  strategy 


Link 

XQ 

Xi 

^2 

^3 

0)4 

a;* 

Link  1  (p  =  2, 

=  64.0) 

1.000 

0.171 

0.097 

0.082 

0.077 

0.077 

Link  2  (p  =  4, 

=  64.5) 

1.000 

0.260 

0.220 

0.183 

0.176 

0.175 

Link  3  (p  =  6, 
am  =  65.0) 

1.000 

0.320 

0.267 

0.264 

0.263 

0.263 

Link  4  (p  =  8, 
am  =  65.5) 

1.000 

0.367 

0.302 

0.299 

0.298 

0.298 

Link  5  (p  =  10, 
am  =  66.0) 

1.000 

0.405 

0.331 

0.327 

0.326 

0.326 

Needless  to  say,  for  a  non-cooperative  game,  a  key  aspect 
of  study  is  the  characteristic  of  Nash  equilibrium  point.  Table 
II  illustrates  the  convergence  behavior  of  the  iterative  best 
response  strategy  defined  in  section  (III-E)  with  M  =  5, 
Pm  =  0.125  and  different  p  and  am  for  each  individual 
link.  It  is  clear  from  Table  II  that  the  thresholds  for  all  the 
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links  converge  to  the  equilibrium  point  within  a  few  («  5) 
iterations.  Note  that  the  time  constraint  for  each  individual 
link,  am,  in  this  example  is  less  than  its  corresponding  critical 
time  constant  (refer  to  the  corresponding  critical  point  in 
table  (I)).  Thus,  the  table  shows  that  the  algorithm  achieved 
convergence  even  when  the  imposed  constraint  is  less  than  the 
corresponding  critical  time  constant. 

TABLE  III 

Verification  of  prop.  3.3 


Link 

ex* 

{pm  =  0.125) 

Vm 

oJn,  Vm 

Link  1 

66.12 
(p  =  2) 

0.1504 

0.1504 
{am  =  67.0) 

0.077 

{am  =  64.0) 

Link  2 

64.81 
(p  =  4) 

0.2188 

0.2188 

{am  =  67.5) 

0.175 

{am  =  64.5) 

Link  3 

64.14 

(p  =  6) 

0.2652 

0.2652 

{am  =  68.0) 

0.263 

{am  =  65.0) 

Link  4 

63.70 

(p  =  8) 

0.3006 

0.3006 
{am  =  68.5) 

0.298 

{am  =  65.5) 

Link  5 

63.39 
(P  =  10) 

0.3293 

0.3293 

{am  =  69.0) 

0.326 

{am  =  66.0) 

Prop.  3.2  shows  that  there  exists  a  Nash  equilibrium  which 
satisfy  the  (23),  which  is  verified  by  Table  III.  It  is  clear  from 
the  table  that  when  the  imposed  constraint  of  all  the  links, 
am  TO  =  1,  2, ...,  M,  are  bigger  than  the  corresponding  critical 
time  constraint  of  am,  the  threshold  for  each  link  with  delay 
constraint  (Xm,  shown  in  forth  column)  will  be  the  same  as  the 
scenario  without  the  constraint  (Xm,  shown  in  third  column). 
When  the  imposed  delay  constraint  is  less  than  the  a^,  the 
threshold  (shown  in  fifth  column)  will  be  different  than  the 
corresponding  x'm- 

V.  Conclusions  and  Future  Work 

In  this  paper,  we  considered  an  ad-hoc  network  where 
many  links  contend  for  the  channel  using  random  access, 
and  studied  distributed  opportunistic  scheduling  (DOS)  un¬ 
der  average  delay  constraint  from  two  different  perspectives. 
First,  we  study  DOS  with  delay  constraints  from  a  network¬ 
centric  perspective,  with  the  objective  to  maximize  the  overall 
throughput  subject  to  the  average  constraint  on  the  network¬ 
wide  probing  and  transmission  time.  We  showed  that  the 
optimal  DOS  strategy  under  such  delay  constraint  is  a  pure 
threshold  policy.  Specifically,  we  found  that  there  exist  a 
critical  time  constant,  a*\  if  the  imposed  delay  constraint  is 
less  than  the  a*,  the  optimal  threshold  is  a  function  of  a; 
otherwise,  the  imposed  delay  constraint  has  no  effect  on  the 
optimal  scheduling  and  the  optimal  policy  remains  the  same 
as  if  the  delay  constraint  did  not  exist.  We  showed  that  the 
critical  time  a*  is  a  decreasing  function  of  average  SNR  and 
contention  probability.  Next,  from  the  user-centric  constraint 
perspective,  each  individual  link  has  its  own  average  time 
constraint.  In  this  case,  the  threshold  selection  for  different 
links  is  treated  as  a  non-cooperative  game,  in  which  every 
link  strives  to  maximize  its  throughput  subject  to  its  own 
individual  delay  constraint.  We  explore  the  existence  of  the 
Nash  equilibrium  and  showed  that  the  Nash  equilibrium  can  be 


achieved  by  iterative  algorithms.  Similar  to  the  network-centric 
case,  we  show  that  there  exists  a  critical  time  vector  {am} 
such  that  only  when  all  delay  constraints  am  >  ctm^m,  then 
the  delay  constraints  have  no  impacts  on  the  optimal  threshold 
in  the  Nash  equilibrium. 

In  this  paper,  we  considered  the  average  delay  constraint. 
It  would  also  be  of  interest  to  consider  individual  packet 
lifetime  constraint.  Different  from  the  average  delay  constraint, 
the  packet  life  time  constraint  is  imposed  on  scheduling  of 
individual  packets  and  is  essentially  a  constraint  on  sample- 
path  realizations.  Our  study  along  this  line  is  underway. 

In  summary,  we  took  some  initial  steps  towards  studying 
channel-aware  distribution  scheduling  in  ad  hoc  networks 
under  a  delay  constraint  for  real-time  traffic.  In  particular,  we 
characterized  the  fundamental  tradeoff  between  the  throughput 
gain  from  better  channel  conditions  and  the  cost  for  channel 
probing  that  may  cause  the  delay.  As  expected,  the  scheduling 
policy  tends  to  be  more  conservative  by  setting  a  smaller 
threshold  when  the  time  constraint  becomes  tighter. 

Appendices 

A.  Proof  OF  Proposition  3.1 

The  proof  of  Proposition  3.1  hinges  heavily  on  the  tools  in 
optimal  stopping  theory  [6]  and  Lagrange  duality  theory  [14]. 
We  derive  the  optimal  solution  in  the  following  four  steps. 

Step  1:  Based  on  Theorem  1  in  [6,  Chapter  6],  the  main 
problem  (7)  is  first  transformed  into  the  following  problem: 

max  E[Ri^T]  —  xE\Tm],  subject  to  W  e  Qa-  (35) 

Let  (t){a)  denote  the  optimal  value  for  the  primal  problem  (35). 

Step  2:  Next,  consider  the  problem  (35)  with  Lagrangian 
relaxation: 


max  E[R]\[T]  —  {x+X)E[TN]  +  Xa,  subject  to  N  G  Q.  (36) 
Define 

N*{x,X)  =  SiVgmsLX  E[RnT]  -  {x  +  X)E[Tn],  (37) 

NeQ 

and 


V*{x,  A)  ^  E[R^M>i.,x))T]  -{x  +  X)E[Tn^^,^x)]-  (38) 

Following  the  same  procedure  as  in  Lemma  (2.1),  it  can  be 
shown  that 

N*(x,  A)  =  min{n  >  1  :  R^  >  x  -f  A  H - ^ — ^},  (39) 

and 


E 


Rn  —  (x  -f  A)  — 


V*{x,X) 

T 


(x  -I-  A)? 
Tps 


(40) 


Consequently,  from  the  corollary  3.1  of  [5],  we  have  that 


Ps 


1  —  Fr  ( X  -f  a  -f 


V{x,X) 


Step  3:  Solve  the  dual  problem: 

'0(a)  =  minLa;(A),  subject  to  A  >  0, 


+  T.  (41) 


(42) 
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where  the  dual  objective  is  given  by 

L^{X)  =  V*{x,X)  +  Xa. 


(43) 


Let  A*(a;)  =  arg  min  (A) .  By  the  complementary  slack- 

A>0 

ness  condition  in  Theorem  4  in  [8]  and  (41),  we  have  that 


A*(a;) 


Ps 


1  -  Ffl  (a;  +  A*(a;)  + 

+X*ix)T  -  X*ix)a  =  0.  (44) 


Step  4:  By  Theorem  1  in  [6,  Chapter  6],  the  optimal 
throughput  X*  can  be  achieved  if  the  the  optimal  value  for  the 
primal  problem  is  0.  Accordingly,  if  there  is  no  duality  gap,  the 
optimal  value  for  the  dual  problem  should  be  0  too.  Therefore, 
we  characterize  x*  by  solving  the  following  equation; 

L,{X*{x))=0.  (45) 

To  this  end,  we  consider  the  following  two  cases. 

Case  1:  If  A*(a;*)  >  0,  then  it  follows  from  (44)  that 


< +  A*«)  + 


T 


=  F. 


-1 

R 


1  - 


Ps{a  -T)  J  ' 

(46) 


E 


Combining  (46)  and  (40)  yields  that 

T 


Rn  —  F, 


-1 

R 


1  - 


Ps{a  -  T) 

Using  (47)  in  (46),  we  have  that 

=  (^1- 


«  +  A*(x*))t 


PsT 


(47) 


PsT" 


E 


Rn  —  F, 


-1 


1  - 


Ps{a  -  T) 

T 

Ps{a  -  T) 


It  then  follows  from  (47)  and  (48), 

L.{X*{xl))  =  V*{xl,  X*(xl))  +  X*{xl)a 
1  - 


(48) 


(49) 


=  TFj 
PsT 


■E 


+a 


PsT 


E 


Ps{a  -  T) 


Rn  —  Ft, 


Rn  —  Ft, 


1  - 


Ps{a-T) 


1  - 


Ps{a  -  T) 


)1 

1 - 

*  3 
H 

1 

1  J 

Since  Lx{X*{x))  =  0,  we  have  that 


Tj.*  —  T  p-l 

•‘'a  —  a^R 


Note  that 


Ps(a-T)) 


(50) 


A*«)  = 


PsT 


xE 


Rn  —  F 


-1 


1  - 


Ps{a  -  T) 


(51) 

-  X*  >  0. 


It  follows  that  (51)  is  equivalent  to 


Ps{a  -  T) 


<  ’’Fe 

T 


Rn  —  F, 


-1 


1  - 


Ps{a-T) 

Case  2:  Otherwise,  if  A*(x*)  =  0,  we  have  that 
L,(A(x*))  =  U*(x*,0)  =  0. 


(52) 


(53) 


It  follows  from  (40)  that 


E 


{RnT-xIT))- 


Ps 


(54) 


which  is  exactly  (6).  Therefore,  x*  =  x*. 

Observing  that  the  left  side  of  (53)  is  monotonically  strictly 
increasing  (by  the  continuous  assumption  of  Ffl(r))  in  a 
from  0  to  oo  as  a  grows  from  —  +  T  to  oo,  and  the  right 
side  is  monotonically  strictly  decreasing  ^^E  [7?(n)T]  to  0, 
therefore,  there  exists  a  unique  a*  that  is  the  solution  of  (10). 
And  when  a  <  a*,  we  have  Case  1,  and  when  a  >  a*,  we 
have  Case  2.  Using  the  above  results,  it  can  also  by  verified 
that  the  conditions  in  Theorem  4  in  [8]  are  satisfied  due  to  the 
continuity  of  Tii(x),  and  therefore,  there  is  no  duality  gap. 
The  proof  is  concluded. 
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